DE eng

Search in the Catalogues and Directories

Page: 1 2
Hits 1 – 20 of 38

1
AUTOLEX: An Automatic Framework for Linguistic Exploration ...
BASE
Show details
2
When Being Unseen from mBERT is just the Beginning: Handling New Languages With Multilingual Language Models
In: NAACL-HLT 2021 - 2021 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies ; https://hal.inria.fr/hal-03251105 ; NAACL-HLT 2021 - 2021 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Jun 2021, Mexico City, Mexico (2021)
Abstract: International audience ; Transfer learning based on pretraining language models on a large amount of raw data has become a new norm to reach state-of-theart performance in NLP. Still, it remains unclear how this approach should be applied for unseen languages that are not covered by any available large-scale multilingual language model and for which only a small amount of raw data is generally available. In this work, by comparing multilingual and monolingual models, we show that such models behave in multiple ways on unseen languages. Some languages greatly benefit from transfer learning and behave similarly to closely related high resource languages whereas others apparently do not. Focusing on the latter, we show that this failure to transfer is largely related to the impact of the script used to write such languages. We show that transliterating those languages significantly improves the potential of large-scale multilingual language models on downstream tasks. This result provides a promising direction towards making these massively multilingual models useful for a new set of unseen languages.
Keyword: [INFO.INFO-CL]Computer Science [cs]/Computation and Language [cs.CL]
URL: https://hal.inria.fr/hal-03251105/file/NAACL21_Muller_et_al.pdf
https://hal.inria.fr/hal-03251105/document
https://hal.inria.fr/hal-03251105
BASE
Hide details
3
SD-QA: Spoken Dialectal Question Answering for the Real World ...
BASE
Show details
4
SD-QA: Spoken Dialectal Question Answering for the Real World ...
BASE
Show details
5
Phoneme Recognition through Fine Tuning of Phonetic Representations: a Case Study on Luhya Language Varieties ...
BASE
Show details
6
Machine Translation into Low-resource Language Varieties ...
BASE
Show details
7
Code to Comment Translation: A Comparative Study on Model Effectiveness & Errors ...
BASE
Show details
8
Systematic Inequalities in Language Technology Performance across the World's Languages ...
BASE
Show details
9
Multilingual Code-Switching for Zero-Shot Cross-Lingual Intent Prediction and Slot Filling ...
BASE
Show details
10
Investigating Post-pretraining Representation Alignment for Cross-Lingual Question Answering ...
BASE
Show details
11
Towards More Equitable Question Answering Systems: How Much More Data Do You Need? ...
BASE
Show details
12
Cross-Lingual Text Classification of Transliterated Hindi and Malayalam ...
BASE
Show details
13
Evaluating the Morphosyntactic Well-formedness of Generated Texts ...
BASE
Show details
14
Evaluating the Morphosyntactic Well-formedness of Generated Texts ...
BASE
Show details
15
Towards more equitable question answering systems: How much more data do you need? ...
BASE
Show details
16
Lexically Aware Semi-Supervised Learning for OCR Post-Correction ...
BASE
Show details
17
When is Wall a Pared and when a Muro? -- Extracting Rules Governing Lexical Selection ...
BASE
Show details
18
When is Wall a Pared and when a Muro?: Extracting Rules Governing Lexical Selection ...
BASE
Show details
19
Lexically-Aware Semi-Supervised Learning for OCR Post-Correction ...
BASE
Show details
20
AlloVera: a multilingual allophone database
In: LREC 2020: 12th Language Resources and Evaluation Conference ; https://halshs.archives-ouvertes.fr/halshs-02527046 ; LREC 2020: 12th Language Resources and Evaluation Conference, European Language Resources Association, May 2020, Marseille, France ; https://lrec2020.lrec-conf.org/ (2020)
BASE
Show details

Page: 1 2

Catalogues
0
0
0
0
0
0
0
Bibliographies
0
0
0
0
0
0
0
0
0
Linked Open Data catalogues
0
Online resources
0
0
0
0
Open access documents
38
0
0
0
0
© 2013 - 2024 Lin|gu|is|tik | Imprint | Privacy Policy | Datenschutzeinstellungen ändern